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We propose a computationally efficient multilevel coding scheme to achieve 
the capacity of an ISI channel using layers of binary inputs. The transmitter em- 
ploys multilevel coding with linear mapping. The receiver uses multistage decoding 
where each stage performs a separate linear minimum mean square error (LMMSE) 
equalization and decoding. The optimality of the scheme is due to the fact that the 
^ ' LMMSE equalizer is information lossless in an ISI channel when signal to noise ratio 

is sufficiently low. The computational complexity is low and scales linearly with the 
length of the channel impulse response and the number of layers. The decoder at 
each layer sees an equivalent AWGN channel, which makes coding straightforward. 
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O 1 introduction 
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I/-) , High bandwidth efficient communication systems require the use of multilevel or multi- 

phase constellations. The major difficulty of applying a coded modulation scheme, such 
as trellis coded modulation [1] and bit-interleaved coded modulation [2], to an intersymbol 
interference (ISI) channel is receiver complexity. Clearly, the optimal joint equalization 
and decoding scheme, such as [3], leads to extremely high complexity. Even in the 
context of Turbo equalization [4] , a suboptimal yet very efficient iterative approach, the 
optimal BCJR-based equalizer has exponential complexity in both channel memory and 
constellation size. Various equalizers with reduced complexity, such as minimum mean 
square error (MMSE) equalizer, are proposed in [5], [6] at a cost of degraded performance. 

This paper proposes a coded modulation scheme for a static ISI channel with capacity 
achieving performance and very efficient computation. The idea is to do multilevel coding 
(MLC) [7], [8] and multistage decoding with a linear mapping [9] at the transmitter and 
a separate linear MMSE (LMMSE) equalization and decoding at the receiver. Minimal 
computation is required and will scale linearly with channel length and the number of 
layers. The number of layers M is large so that, by the central limiting theorem, the 
output of the mapper approaches a Gaussian distribution. More importantly, this paper 
shows that an LMMSE equalizer in an ISI channel with non-white Gaussian noise is 
information lossless when the signal to noise ratio (SNR) is sufficiently low. Therefore, 
given a fixed total power, a large M will effectively drive each layer to operate at a low 
SNR region, in which, the proposed separate LMMSE equalization and decoding is not 
only efficient but also optimal. The task of code design is also simple since the decoder 
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Figure 1: System model. 



at each layer sees an equivalent AWGN channel. Consequently, the scheme can achieve 
the i.i.d. Gaussian capacity of an ISI channel if each layer employs a capacity achieving 
code. 

This paper is organized as follows. Section |21 presents the MLC scheme with the 
LMMSE equalization algorithm. The optimality of the scheme is discussed analytically 
in Sectional and also is numerically demonstrated in Section 0] Some design issues, such 
as power allocation and rate design, are discussed in Section |U The result shows that if 
the power of each level is properly allocated, only a moderate number of layers is required 
for the overall system to approach the channel capacity. 



2 System Model 

This section presents the overall system of the MLC with LMMSE equalization as shown 
in Fig. [T] Let {xj(k)}^ =1 be the scaled version of a sequence of identically, independently 
and uniformly distributed binary sequences, such that Xj(k) = —yPj or +^/Pj with 
equal probability for all k. A total of M such mutually independent BPSK sequences, 
{xj(k)}^ =1 for j = 1, • • • , M, are summed to produce the transmitted sequence {x(k)}^ =1 , 
where x(k) = ^2j =1 Xj{k). In general, each BPSK layer has a different power level Pj 

and the total power is P = Y2jLi^j- The ISI channel is modelled as a time-invariant 
causal FIR filter with order Lh and an impulse response h = {h(0), • • • , h(Lh)} that is 
known to both the transmitter and the receiver. Let w(k) ~ A/"(0, <r^) be the AWGN. 
The received signal is written as 

M L h 
j=l i=0 

The receiver employs multistage decoding, i.e., it successively equalizes and decodes 
M BPSK layers from layer 1 to layer M. Once a layer is correctly decoded, its effect 
on the channel output can be completely removed by filtering it with h and subtracting 
the resulting waveform from the received signal. After cancelling the interferences of all 
decoded layers, the current layer treats the undecoded layers as noise and employs an 
LMMSE filter to compute the likelihood ratio of the input bit. A memoryless channel 
decoder uses these likelihood ratios to decode the codeword and feed the hard decision 
to the next layer. This receiver of layer m is shown in Fig [21 

Consider the decoding process of the mth stage. We assume the receiver has correctly 
decoded layer 1 to m — 1, i.e. Xj(k) = Xj(k) for all k and j — ,m — 1. The decoded 



layer interference cancelled signal at layer m is 

M L h 

Vm{k) = ^2^2h{i) Xj (k-i)+w(k). (2) 

j=m i=0 

The receiver uses an FIR LMMSE filter of order 2L g to estimate x m (k) from a vector of 
channel output y m (k) = \y m (k — L g ), ■ • • , y m (k + L g )] T for any k. Using vector notation, 
define a Toeplitz matrix H G TZ( 2L s+ 1 ) x ( 2L a+ L h) anc i its block partition as 

h{L h ) ■■■ h(0) 

h(L h ) ■■■ h(0) ••• 



H 











[H l7 h fe ,H 2 ] 



(3) 



h{L h ) ■■■ h(0) 

where h fc G H^ 2L « + ^ xl , Hi G Ti(^ g +iML g +L h ) and jj 2 e n (2L g +i)xL^ Furthermore, 
define H isi = [H 1; H 2 ]. Therefore, 

M 

y m (k)=h k x m (k) + H. isi x%(k) + Hx 3 -(fc) + w(A;), (4) 

j=m+l 

where Xj-(fc) = [xj(fc-L fl ), • • • , x j (fc + Z,,,)] T , x^*(fc) = [x m (fc-L fl ), • • • ,x m (k-l),x m (k + 
1), • ■ ■ , x m (k + L g )] T and w(k) = [w(A; — L g ), ■ ■ ■ , + £ 5 )] T . In (J3J), the first term is 
due to the desired input, the second term is the ISI, the third term is the interference 
from undecoded layers and the last term is AWGN. From linear estimation theory, the 
LMMSE filter at layer m in vector form is 

M 

g m = ElyUkWlikT 1 E[y m xl(k)} = P m ( E ^ HRt + <*M. 



(5) 



J =171 



The LMMSE estimate of x m (k) is thus 

x m (k) = gitfmik). (6) 
From (j3J), (jUJ) can be equivalently written as 

x m (k) = a m x m (k) + Cm(k), (7) 
where a m = g^hfc is the equivalent channel gain and 

M 

Uk) = slH tsl < l (k) + gl Hx #) + slMk) (8) 

j=m+l 

is the equivalent channel noise. From the central limiting theorem, the equivalent noise 
has a Gaussian distribution such that Cm(k) ~ A/"(0, cr 2 m ), where 

M 

°L = P m g^H-(H-) t g m + ^glHHtg m + ojgtg. (9) 



j=m+l 



Thus, the likelihood function of x m (k) is computed from 



P(x m (k)\x m (k)) 



2lTa 2 
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{x m {Jt) QL m X m 

2a 2 



(10) 



The subsequent decoder decodes the codeword solely based on the set of likelihood ratios. 
Its hard decision is feedback to the next stage. 
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Figure 2: Layer m receiver. 

3 Optimality 

In this section, Theorem^andElwill establish that given a sufficiently large number of lay- 
ers, the proposed multilevel coding and its receiver, which sequentially (non-iteratively) 
performs LMMSE equalization and decoding, can approach the ISI channel capacity with 
i.i.d. Gaussian input. 

The key observation is that, at any layer, if the signal to interference plus noise ratio 
(SINR) is sufficiently low, the LMMSE filtered channel retains the original ISI channel 
capacity. Theorem ^ shows this for Gaussian input and Gaussian interference. Theorem 
12] extends this results to the M-layered MLC scheme with BPSK inputs. Throughout 
this paper, the vector notation x = [x(0), • • • , x(N — 1)] T will be used. 

Theorem 1 Consider an ISI channel with input x(k), interference z(k) and noise w(k), 

y {k) = h (i) {x{k -i)+ z{k - i)) + w{k), (11) 

i=0 

where h = {h(0), • • • , h(Lh)} is the channel impulse response, and x(k), z(k) and w(k) 

are i.i.d. Gaussian random sequences with zero mean and variance (j 2 x , o~1 and respec- 
tively. Let x(k) be the output of the LMMSE filter, then 

/(x: x) . , 

lim -^-L-L = i. 12 
^/K 2 +<4Ho J(x; y) 

Theorem 2 Let C 9,ISI be the ISI channel capacity with Gaussian inputs. Let C b,MLC be 
the capacity of proposed M -layer multilevel coding with LMMSE equalization, where the 
input of each layer is i.i.d. BPSK of power P m and the LMMSE filter has infinite length. 
If the total power P is finite and the power allocation at each layer satisfies 

M 

Pm<«+ Yl P i) form = l,---,M (13) 

j=m+l 

where is the variance of AWGN, then 

lim C h - MLC = C 9 ' ISI . (14) 

A/->oo 

The proof of Theorem ^ and 121 is omitted due to space limitation. 

The convergence of (fT2"|) as a^./{al + a^u) — > is illustrated in Fig. El for different 
values of cr^/cr^ and a random 10-tap ISI channel. The LMMSE used is a 401-tap FIR 
filter as designed according to (0). It is clearly shown in Fig. Q] that the convergence 
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Figure 3: Convergence of the ratio of LMMSE filtered capacity over the original ISI 
channel capacity as SINR decreases for Gaussian input and interference. 

happens whether the AWGN or interference dominates. This is important for the MLC 
scheme because the interference to noise ratio varies for different layers. 

Although the optimality in Theorem El is established for a large number of layers, next 
section will show how the power of each layer can be allocated to minimize the number 
of required layers. 



4 Practical design issues and numerical results 

MLC with multistage decoding can approach capacity if and only if each lay uses a 
capacity achieving code whose rate is equal to the layer's capacity [8]. The proposed 
MLC employs a linear mapping, and we are free to allocate the power of each layer. 
Consequently, the rate of each layer can be designed flexibly. A good power allocation 
scheme is important in our case. This section discusses these practical design issues 
and presents numerical results. Two channels are used for simulation, a short channel 
hi = {1,1}, and a randomly generated long channel 

h 2 = {-0.432, -1.665, 0.125, 0.287, -1.146, 1.190, 1.189, -0.037, 0.327, 0.174}. 
4.1 Achievable rate at each layer 

Since we are constrained in receiver structure, we do not intend to calculate the capacity 
of each layer. Instead, we will compute its achievable rate under the given LMMSE 
equalizer. The computation is based on the statistics of the bit probabilities computed 
by an actual receiver from a simulated channel output sequence. No Gaussian assumption 
is made here. The achievable rate of the layer m sub-channel is given by 

R m = l(x m {k);x m {k)) =l-E[-log 2 P(x ro (A;)|z m (A;))] (15) 




Figure 4: Achievable rate using equal power allocation for a short channel hi 



where the a posteriori probability can be derived from (fTU|) as 

P(x m (k)\x m (k)) 



P(x m {k)\x m {k)) 



P(x m (k)\ + P(x m (k)\ -y/TQ 



(16) 



and E[— log 2 P(x m (k)\x m (k))] is evaluated using Monte Carlo simulation. Thus, the 
overall achievable rate of the multilevel scheme is Rmlc — Ylm=i ^m- 



4.2 Power allocation 

We consider three power allocation schemes as follows. 

1) Equal power. In this scheme, each layer has the same power. Fig. 0] and Fig. El 
show the achievable rate of the equal power MLC with M = 10, 20, 50, 100. 

2) Equal distance. This power allocation scheme can produce a constellation with 
equal distance. For example, to produce a uniformly distributed 2 M -ary ASK sequence, 
the power of each layer should satisfy Pj = 4P J+ i, j = 1, • • ■ , M— 1. This can be extended 
to a QAM constellation if each dimension transmits an independent ASK sequence. Note, 
at moderate to high SNR, this power allocation scheme is not capacity achieving since 
each layer still operates at moderate SINR. 

3) Equal rate. This scheme allocates the power in such a way that the achievable rate 
at each layer is identical, i.e., R\ = Ri — • ■ • — Rm = Rconst, where R CO nst is some fixed 
rate. A simulation based numerical procedure is required to determine the power of each 
layer, starting from layer M to layer 1. Fig. Inland Fig. [7| compare the achievable rate 
of the equal rate MLC to the i.i.d. Gaussian capacity for both a short and a long ISI 
channel. 




Figure 5: Achievable rate using equal power allocation for a long channel /12 

In summary, both equal power and equal rate power allocation can achieve chan- 
nel capacity, while equal distance power allocation can generate desired ASK or QAM 
constellations but does not achieve capacity. Furthermore, equal rate power allocation 
requires fewer layers than the equal power scheme to achieve the same capacity. 

4.3 Code Design 

A common tool for designing the component codes at each layer is equivalent channel 
model [8], [10]. In the proposed MLC with LMMSE filtering, the equivalent channel, as 
seen in (J7J), is simply an AWGN channel with BPSK input. Thus, many existing capacity 
achieving codes, such as low-density parity-check (LDPC) codes [11], and their design 
technique, e.g., density evolution [12], can be applied in a straightforward way. The 
above code design process can be further simplified using equal rate power allocation. In 
this case all equivalent channels of all layers are equivalent to an AWGN channel with 
a given capacity R CO nst- Therefore, we only need to design a single code for this AWGN 
channel and apply the code and its encoder/decoder pair to all layers. Note, a random 
interleaver will be used for each layer to avoid decision feedback error propagation in this 
case. 

The second task is to assign a code rate for each layer. When a capacity achieving 
code with infinite block length is available, we can use capacity rule [8] so that the code 
rate at layer j is equal to the achievable rate Rj. When code is not capacity achieving, 
the code rate must be smaller than the achievable rate. Furthermore, since the MLC 
scheme relies on perfect decoding of all layers, the code rate must be designed so that 
all layers will have a low BER at a given overall SNR simultaneously. Other techniques 
such as random coding bound [8] can also be applied to design the rate. 




Figure 6: Achievable rate using equal rate power allocation for a short channel, where 
M is the number of layers and R is the total achievable rate of MLC. The solid curve is 
the ISI channel capacity with i.i.d. Gaussian input. 



5 Extension and conclusion 

This paper proposes an MLC and LMMSE equalization scheme and shows that it can 
achieve channel capacity for ISI channels with i.i.d Gaussian inputs. A further extension 
to achieve the ultimate "water-filling" capacity is also straightforward by incorporating 
a spectral shaping filter at the transmitter and a corresponding LMMSE equalizer at the 
receiver. The scheme is computationally efficient and is especially attractive for systems 
with severe ISI. 

The principle of MLC with linear mapping and multistage decoding can be applied to 
correlated or block fading channels with unknown channel states. The fundamental idea 
is using the decoded layers as training symbols. The receiver then estimates the channel 
based on the training symbols. As long as the power of each layer is very small, estimation 
and decoding can be decoupled without loss. This is under current investigation. 
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